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Abstract. By using the degree theory and the r— topology of Kryszewski and 
Szulkin, we establish a version of the Fountain Theorem for strongly indefinite 
functionals. The abstract result will be applied for studying the existence of in- 
finitely many solutions of two strongly indefinite semilinear problems including 
the semilinear Schrodinger equation. 



Introduction 

The Fountain Theorem established by T. Bartsch [1] and M. Willem [25] is a 
powerful tool for studying the existence of infinitely many critical points of some 
indefinite functionals, which are symmetric in the sense of admissibility posed by 
Bartsch [T] (see also [71 US]). This theorem has been used by several authors to 
study the existence of infinitely many large energy solutions of various semilinear 
problems, see for instance [TJ [3 [8j [9l [TOl [Til [25] . We also mention the paper of W. 
Zou [12], where a variant Fountain Theorem was established without (PS*)— type 
assumption. 

. The aim of this paper is to generalize the Fountain Theorem in order to apply it 
to a wider class of indefinite functionals, specially to strongly indefinite functionals; 
that is functionals of the form (j){u) = ■^(^Lu,u^ — ip{u) defined on a Hilbert space 
X, where L : X — > X is a selfadjoint operator with negative and positive eigenspace 
both infinite-dimensional. The study of such functionals is motivated by a number 
of problems from mathematical physic. They arise for example in the study of 
periodic solutions of the one-dimensional wave equation, in the study of periodic 
solutions of Hamiltonian systems, or in the existence theory for systems of elliptic 
equations. 

. The paper is organized as follows: In the first section, the main abstract results 
are outlined and future applications are discussed while in section 2, the degree 
theory of Kryszewski and Szulkin is introduced and a Borsuk-Ulam type theorem 
for admissible maps is stated. In section 3, we construct a deformation which will 
be very helpful to establish the new fountain theorem in section 4. Sections 5 
and 6 are dedicated to the application of the abstract result to a nonlinear sta- 
tionary Schrodinger equation and to a noncooperative system of elliptic equations, 
respectively. 
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1. Main Results 

Let X be a real Hilbert space with inner product (•), norm || • || and decomposition 
X = Y @ Z, where Y is closed and separable, and Z = ©^^qMcj . Define for fc 5= 2 
and < rfe < pk, 

Yk:=Y® (©)-^oRej), Zk := ©JU^Cj, 

Bk ■■= {u 6 Yfc I l|wl| ^ pk} and Nk := {ue Zk \ \\u\\ = rk}- 
Consider on X = Y (B Z the r— topology introduced by Kryszewski and Szulkin 
in [2] (see also [25], Chapter 6), and let (p : X ^ M. he a. C^— functional such that 
ip is T— upper semicontinuous, and Vp is weakly sequentially continuous. We are 
interested in the obtention of critical points of p when the latter has the following 
linking geometry 

sup p{u) < inf p{u). 

In order to achieve this goal, we assume that tp is invariant under an admissible 
action of a finite group G (see Definition [5] below), which the antipodal action of 
Z2 is a particular case. More precisely, we will introduce the following assumption: 

(^1) A finite group G acts isomctrically and r-isometrically on X, and the action 
of G on every subspace of X is admissible (in the sense of Definition [6]) . 
Roughly speaking, the above-mentioned admissibility authorizes an extension of the 
Borsuk-Ulam theorem for a certain class of functions conveniently called (t— admissible 
later in the text. By taking advantage of the notion of admissible group, we show 
that Bk and Nk link in the following sense: It j : Bk ^ X is t— continuous and 
equivariant, j\dBk = ^d, and every u e Bk has a r— neighborhood in Yk such 
that (id — j) (iVu n int{Bk)) is contained in a finite-dimensional subspace of X , then 
j{Bk) n Nk ¥= 0. Since in our purpose Y can be infinite-dimensional, the Brouwer 
degree (which is usually used in the finite-dimensional case) will be replaced with 
the Kryszewski-Szulkin degree (see Definition [3] below) in the establishment of the 
above linking. By constructing an equivariant deformation with the fiow of a certain 
gradient vector field, we finally show that if in addition 

sup p{u) < 00, 

then there is a sequence (mJJ) c; X such that 

v'iK) 0, (p{ul) inf sup (^«) as n ^ cx), 

where Tk is a class of maps j : Bk ^ X defined in Theorem [11] The abstract result 
will be used to study the existence of infinitely many large energy solutions of the 
two following strongly indefinite semilinear problems. 

1.1. Semilinear Schrodinger equation. For the first application we consider the 
following nonlinear stationary Schrodinger equation 

, , ( -Au + V{x)u = f{x,u), 

under the following assumptions: 

(Vo) The function V : M.^ — > M is continuous and 1— periodic in xi, xn and 
lies in a gap of the spectrum of — A + y. 
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(/i) The function / : x M ^ M is continuous and 1— periodic with respect 

to each variable Xj,j = l,...,N. 
(/2) There is a constant c > such that 

\f{x,u)\^cii + \ur') 

for all xeR^ andue R, where p > 2 for = 1, 2 and 2 < p < 2N/N - 2 
UN ^3. 

(/a) fix^u) = o{\u\) uniformly with respect to x as \u\ 0. 
(/4) There exists 7 > 2 such that for aU a; e and u e M\{0} 

< jF{x, u) ^ uf{x, u), 

where F{x^ u) := /(x, s)ds. 
(/s) For all a; e and m e R, f{x,-u) = -f{x,u). 
The natural energy functional associated to (V) is given by 

(p{u) := f {\\7u\^ + V{x)u^ - F{x,u))dx, ueH^R^). 

By (Vb) the Schrodinger operator —A + V (in L^(R^)) has purely continuous 
spectrum, and the space iJ^(R^) can be decomposed into iJ^(R^) = Y ® Z such 
that the quadratic form 

ueH^{R^)^{ {\\7u\^ + V{x)u^)dx, 

is negative and positive definite on Y and Z respectively. Both Y and Z are 
infinite-dimensional, so the functional ip is strongly indefinite. This case has been 
of large interest in the last two decades, existence and multiplicity results have 
been obtained by different methods, see for instance [31[T31[Tll[Tni[TOl[I71[TH]. We 
prove in this paper that, under the above assumptions, (V) has infinitely many 
large energy solutions. 

1.2. Noncooperative elliptic system. As the second application we study the 
following system: 

{Au = Hu{x,u,v) in f2, 
-Av = hS{x,u,v) in n, 
u = V = on dft, 

where il is an open bounded subset of R^. It is well known that (V) has a 
variational structure, and the associated Euler-Lagrange functional is given by 

Hu,v):= \ (hvv\^-l\yu\^-Hix,u,v))dx u,veH^{n). 
Jr« \z z / 

By taking advantage of the new Fountain Theorem, we obtain infinitely many large 
energy solutions of (V), provided the following conditions are satisfied: 

{hi) G Ci(n X R X R) and H{x, 0, 0) = 0, Vx e U. 

(/12) 3c > such that 

\Hu{x,u,v)\ + \H,{x,u,v)\ < c(l + \ur^ + \v\P-^), 

for all X eR^ and u,v e R, where p > 2 for iV = 1, 2 and 2 < p < 2N/N - 2 if 
iV > 3. _ 
(hs) Q < pH{x,u,v) uHu{x,u,v) + vHy{x,u,v), for {u,v) ^ (0,0), \fx e fl. 
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(hi) H{x,—u,—v) = H{x,u,v), Vu, w 6 M, Vx e 57. 

. The solutions of {V') represent the steady state solutions of reaction-diffusion 
systems which are derived from several applications, such as mathematical biology 
or chemical reactions (see [19] and reference therein). Recently the existence and 
multiplicity of solutions for noncooperative elliptic systems of the form (V') have 
been proved by several authors, see for instance [Sj lU [3 [6, JJ^ and references therein. 

2. Kryszewski-Szulkin degree theory 

Let {H, (•), II • II) be a separable Hilbert space. Let (6j)j>o be a total orthonormal 
sequence in H and let 

CO ^ 

We will denote by a the topology generated by the norm || • ||i. Clearly \\y\\i ^ ||y|| 
for every y e T-L, and moreover if (y„) is a bounded sequence in H then 

Vri ^ y ^=> yn ^ y. 

Let U be an open bounded subset of % such that U is cr— closed. The following 
definitions are due to Kryszewski and Szulkin (see [25]). 

Definition 1. A map / : U ^ H is said to be tr-admissible if it meets the two 
following conditions. 

(1) / is (7— continuous, 

(2) each point u e U has a ct— neighborhood such that {id — f){Nu n U) is 
contained in a finite-dimensional subspace of H. 

Definition 2. An application h : [0,1] x U ^ Ti is a a -admissible homotopy if: 

(a) h-\0) n ([0,1] X dU) = 0, 

(b) h is a-continuous, 

(c) Every {t, u) e [0, 1] x t/ has a a -neighborhood A^(t.„) such that |s— /i(t, s)/(t, s) G 
^(t.u) <^ ([0, 1] X [/)} is contained in a finite- dimensional subspace ofH. 

If / is a cr-admissible map such that ^ f{dU), then /^^(O) is cr— closed and 
consequently, ct— compact. Let us consider the covering of /^^(O) by sets Nu which 
are cr— open neighborhoods of w e /^^(O) such that {id — f){Nu n U) is contained 
in a finite-dimensional subspace of So, we can find m points ui, w„j e /~^(0) 
such that /^^(O) cz V := [J^^iNu„ U and {id — /)(A'^ij, n U) is contained in 
a finite-dimensional subspace F oi Vfc = 1, ...,m. The contraction and the 
excision properties of the Brouwer's degree imply that degB{f\VnF,V F) does 
not depend on the choice of V and F, where degs is the Brouwer's degree. This 
leads to the following definition due to Kryszewski and Szulkin: 

Definition 3 (Kyszewski-Szulkin degree). Let f be a a-admissible map such that 
0^ f{dU). The degree of f is defined by 

deg{f, U) := degB{f\vnF, V n F), 

where V and F are defined above. 

Proposition 4. 

(i) If y e U then deg{id — y, [/) = 1. 
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(ii) Let f be a a -admissible map such that ^ f{dU). If deg{f, U) 7^ then there 

exists u e U such that f{u) = 0. 
(Hi) If h is a a-admissible homotopy, then deg{h(t, ■),U) does not depend on the 

choice oft. 

For the proof of Proposition HI we refer the reader to [25] . 
The following theorem was inspired by [5] Theorem 2A{iv). 

Theorem 5 (Borsuk-Ulam theorem for admissible maps). Let U be an open bounded 
symmetric neighborhood of in H such that U is a— closed. Let f : U ^ % be a 
a-admissible odd map. If f{U) is contained in a proper subspace of %, then there 
exists uo G dU such that f{uo) = 0. 

Proof. Assume by contradiction that /^^(O) n dU = 0. Since / is odd, we may 
assume that ^ is a symmetric (i.e —V = V). Let be a proper subspace of "H 
such that f(U) cz F, and let z e H\F. Define h : [0,1] x U H hy h{t,u) : = 
f(u) — tz. One can easily verify that h is a cr- admissible homotopy. By Proposition 
IHJzm), deg{h{0, •), U) = deg{h{l, •), U). The classical Borsuk theorem implies that 
deg{h{0,-),U) = deg{f,U) ^ 0, so deg{h{l,-),U) = deg{f - z,U) 0. It then 
follows from Proposition HI^m) that there exists mq e [/ such that z = /(mq), which 
is a contradiction since z e H\f{U). □ 

Now we need to precise what kind of symmetries we will consider in the sequel. 
We recall that the action of a topological group G on a normed vector space {E, [| • || ) 
is a continuous map G x E ^ E, (5, u) 1— > gu, such that: 

(1) eu = M, Vu e E. 

(2) h{gu) = {hg)u,\fue E, \lh,geG. 

(3) The map m >— > is linear for every g e G. 

The action of G is isometric if \\gu\\ = \\u\\, \/u e E,g e G. A subset F of £^ is 
invariant if gF = F for every g e G. A functional tp : E R is invariant if 
(p{gu) = <p(u), for every u e E and g e G. A map f : X X is equivariant if 
f{gu) = gf{u), for every u e E and g e G. 

Definition 6. Let G be a finite group acting on %. The action of G is said to be 
admissible if e 'H \ gu = u,\fg e G} = {0} and every a-admissible and equivariant 
map f : U ^ "Hq , where U is an open bounded invariant neighborhood of the origin 
in % such that U is a— closed and T-Lq is a proper subspace ofH, has a zero on dU . 

Example 7. Theorem [5] implies that the antipodal action of Z2 on every separable 
Hilbert space is admissible. 



Let y be a closed separable subspace of a Hilbert space X endowed with the 
inner product (•) and the associated norm || • ||. Let P : X ^ Y and Q : X ^ 
be the orthogonal projections. Let (9j) be an orthonormal basis of Y . On X we 
consider a new norm 



3. A DEFORMATION LEMMA 




(1) 



i=0 
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and we denote by r the topology and all topological notions related to the topology 
generated by ||| • ||| (see [2] or [25]). It is clear that |||w||| Moreover, 

if (w„) is a bounded sequence in X then 

Un u Pun Pu and Qun — > Qu. 

We recall some standard notations: 
hei S cz X and Lp e C^{X,^). dist{u, S) := \\u - S\\, distr{u,S) := \\\u - S\l 
Sa := {u e X I dist{u, S) ^ a}, ip°- := {u e X | (p{u) ^ a}. 

The following lemma is somewhat a combination of Lemma 3.1 and Lemma 6.8 
in [25]. 

Lemma 8 (Deformation lemma). Assume that a finite group G acts isometrically 
and T -isometrically on the Hilbert space X. Assume also that ip e C^{X,M.) is 
invariant and T-upper semicontinuous and Vip is weakly sequentially continuous. 
Let S <^ X be invariant and c 6 R, e,6 > such that 

\fue^-\[c-2e,c+2e])nS2S, y{u)\\ ^ ^. (2) 



Then there exists rj e C([0, 1] x ip'^^'^'^,X) such that: 

(i) r]{t, u) = u if t = or if u ^ 'P^^iic — 2e, c + 2e]) n S2S: 

(ii) vh,ip'=+'' n S*) c 

(iii) \\ri{t, u) - w|| I Vu 6 (^^=+2% \/t e [0, 1], 

(iv) ip{ri{-,u)) is non increasing, \/u e cp'^'^'^'^, 

(v) Each point {t,u) e [0, 1] x ip'^'^'^'^ has a t -neighborhood A^(f.,j) such that {v — 
ri{s, v) I (s, v) e Af(t.„) n ([0, 1] x (^'^+2'^)} is contained in a finite- dimensional 
subspace of X, 

(vi) r] is T-continuous, 

(vii) 7](t, •) is equivariant Vt e [0, 1]. 

Proof. Let us define 

w{v) := 2\\Vip{v)\\-'^Vip{v), \fv e ip'^ {[c - 2e, c -\- 2e]) . 

Since V(p is weakly sequentially continuous, for every v e ip~^([c — 2e,c + 2e]) 
there exists a r-open invariant neighborhood Ny of v such that (Vip{u),w{v)) > 1 
Vu e Njj. Since ip is r-upper semicontinuous, N := <p~^(] — oo,c + 2e[) is r-open. 
It follows then that the family 

A/" = {Ny I c - 2e ^ (p{v) ^ c + 2e} u TV 

is a r-open covering of ip'^'^'^'^. Since ((ys'^^^"^, r) is metric, and hence paracompact, 
there exists a r-locally finite r-open covering M := {Mi : i e J} of (/3^+2^ finer than 
^f. Define 

V:=\Jm,. 

iel 

For every i e I we have only the possibilities Mi cz Ny for some v or A/^ cz N. In 
the first case we define Vi := w{v) and in the second case Vi := 0. Let {A^ | i e /} 
be a r-Lipschitz continuous partition of unity subordinated to M and define on V 

h{u) ■.= ^\i{u)vi. 
The map h satisfies the following properties (see Lemma 6.7 of [25]): 
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(a) h is T-locally Lipschitz continuous and locally Lipschitz continuous, 

(b) each point u e V has a t- neighborhood Vu such that h{Vu) is contained in 
a finite dimensional subspace of X, 

(c) {V(p{u),h{u)) ^0\/ueV, 

(d) Vwe ^-i([c- 2e,c+ 2e]), {Vip{u), h{u)) > 1. 

Let us define the equivariant vector field h on V by: 

We claim that h satisfies properties (a), (6), (c) and (d) above. In fact, since ip is 
invariant we have 

{Vip{gu),v) = (ytp{u),g~'^v) \lgeG \tu,veX. 

Thus 

{V^{gu)Mu)) = l-y{y^{u),g-^h{gu)) 
1^1 s^G 



geG 

SO that h satisfies (c) and {d). Let u e 1/, for every g e G there exists a r— neighborhood 
Vgu of git such that hiVgu) is contained in a finite dimensional subspace of X, con- 
sequently IVti := y is a t— neighborhood of u such that is contained 

in a finite dimensional subspace of X and then h satisfies (6). Finally fi obviously 
satisfies (a). 

Let us define 

A:=^-i([c-2e,c+2e]) n 525, 
B =: if-^{[c- e,c+ e\) n Sg, 

ipiu) := distr{u,V\A) distr{u,V\A)+distr{u,B)^ on V, 

and 

f{u) := 'tp{u)h{u), ueV. 

It is clear that / is r-locally Lipschitz, r-continuous, continuous, locally Lipschitz 
and equivariant. By assumption ([2]), ^ ^, which implies ||/(u)|| ^ ^ on 

For each u e the Cauchy problem 

/i(0, u) = u 



has a unique solution fi{-,u) defined on . Moreover fi is continuous on R"'' x ip 
s_ 

4e 



c+2e 



Since ||/(u)|| s: |-, we have for t 5= 
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We also have 



It is easy to verify that if we define 77 on [0, 1] x by ri{t, u) := /i(2et, u), then 

(j), (zi), {in) and {iv) are satisfied. The proof of (w) and {vi) is the same as that 
of h) and c) in Lemma 6.8 of ^25j (with T = 2e). Since / is equivariant, (vii) is a 
direct consequence of the existence and the uniqueness of the solution of the above 
Cauchy problem. □ 

4. An infinite-dimensional version of the fountain theorem 



^3 



00 

In the sequel we assume that Z := = Rcj. 

j = 

We use the following notation: 

k 00 

Yk:=Y® (0 Re,), Zk := Me,, 

j=0 j = k 

Bk := {ueYk \ \\u\\ s: pfc}, Nk := {ue Zk\\\u\\ = rk} where < rfc < pk, k^2. 
We denote Pk : X ^ Yk and Qk : X ^ Zk the orthogonal projections. We define 

°] for j = 0,l,...,fc 

9j-fc-i for j^k + \, 

(where {9j ) is the orthonormal basis of Y we chose at the beginning of section 2) . 
We can define a new norm on X by setting 

00 ^ 

|||u|||fe = max -:^\i.PkU,e'j)l \\Qk+iu\\^. 

Remark 9. Since a direct calculation shows that 

|||7.|||fe ^lllulll and |||u|H2'=+i|||ul|U, VueFfe, 

then for every k, the norms ||| • ||| and ||| • |||fe are equivalent on Y^. In addition, it is 
easy to show that the projections Pk are r-continuous, for every k. 

Lemma 10 (Intersection lemma). Under assumption (Ai), let 7 : Bk — > X such 
that 

(a) 7 is equivariant and 7 \dBk — 

(b) 7 is T-continuous, 

(c) every u e int{Bk) has a t -neighborhood in Yk such that {id — 'y){Nu n 
int{Bk)) is contained in a finite- dimensional subspace of X . 

Then -f{Bk) n Nk ^ 0. 

Proof. Let U = {u e Bk \ ||7(m)|| < Vk}- Since pk > rk and 7(0) = 0, C/ is an open 
bounded and invariant neighborhood of in Yfc. It is clear that Bk is r-closed, so 
we deduce from (b) that U is also r-closed. Consider the equivariant map 

Pk-ij-.U ^Yk-i. 
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(i) Pfc-i7 is T-continuous. In fact, if u„ ^ u, then from (6) 7(un) 7(u) and 
by Remark[9]we have |||Pfe_i(7(u„) — 7(u))||| ^ as n ^ cx). 

(ii) Let u e U. From (c) u has a r- neighborhood Af„ such that {id — 'j){Nu n [/) c 
VK, where is a finite-dimensional subspace of X. Let v e A'^u n U cz Yk = 
Yfc-i ©Kefe, then (id - Pk^ij){v) = Pfe_i(w - 7(1;)) + Xck e W + Rck which 
is finite-dimensional. 

Thus Pfc_i7 : J7 Yk-i is cr— admissible (in the sense of Definition [l] where the 
pair {H, {bj)) in section 2 is replaced by the pair (Yk, (e^))). Since the action of G 
on Yfe is admissible, there exists uq e dU such that Pfe-i7(uo) = 0. This ends the 
proof of the lemma since X = Yfe_i @ Z^. □ 

Theorem 11. Under assumption {Ai), let ip e C^(X, R) he invariant and T-upper 
semicontinuous such that \7ip is weakly sequentially continuous. 
For /c 5= 2, define 

ak ■■= sup (^(m), 

ueYk 

bk ■■= inf (f{u), 

\\u\\=rk 

Ck := inf sup ip(j{u)), 

where 

Tfe := It ■ Bk — > X I 7 is equivariant, r — continuous and 7 1,55^= id. 

Every u e int{Bk) has a r — neighborhood in Ffe such that {id — 7) {Nu n int{Bk)) 
is contained in a finite-dimensional subspace of X. Futhcrmore ip{'j{u)) < Vu e _Bfc 

and 

dfe := sup ip{u). 
ueYk 

M^Pk 

If 

dk < 00 and bk > ak, 
then Ck ^ bk and, for every e 6 ]0, (cfe — afe)/2[ , 5 > and 7 6 Ffe such that 

sup(^0 7 s; Cfc +e, (3) 

there exists u e X such that 

(1) Ck -2e ip{u) ^ Ck + 2e, 

(2) dist(u, 7(Bfe)) ^ 26, 

(3) II ^'HH 86/5. 

Proof. It follows from Lemma [TU] that Ck 5= bk- Assume by contradiction that the 
thesis is false. We apply Lemma|8]with 5 := ^{Bk). We may assume that 

Cfe-2e>afc. (4) 

We define on Bk the map (3{u) := r]{l,j{u)). We claim that /3 G F^. 

(i) It follows from (|4]) and {i) of the deformation lemma that /3\dBk — 

(ii) It is clear that /3 is equivariant and r-continuous, and <p(/3(tt)) ^ (p{u) Vu e Bk. 
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(iii) Let u 6 int{Bk). Since 7 e Ffc, m has a r-neighborhood Nu in Yfc such that 
(id— j)[Nu r\int{Bk)) c Wi, where Wi is a finite-dimensional subspace oi X. 
From (v) of the deformation lemma the point (l,7(w)) has a r-neighborhood 
-^(i,7(tt)) = ^1 ^ such that [z — rj^s, z) | (s, z) e M(i,^(„)) n ([0, 1] x 

(^cfc+2e-j| jg contained in a finite-dimensional subspace W2 oiX. Thus for every 
V e A^„n7-i(M^(„))nBfe, we have {id-(3){v) = {id--/){v)+-f{v)-T]{l,-f{v)) e 
T4^i + W2 which is finite-dimensional. 

Thus fieVk. 

Now by using ([3]) and (ii) of Lemma [8] we obtain 

Cfc sup = sup V9(77(l,7(u))) ^ Cfe - e, 

ll'ilHPfc llflHpfc 
which contradicts the definition of c^. □ 

Theorem 12. Under assumption (^1), let ip e C^(X, M) be invariant and r-upper 
semicontinuous such that V^p is weakly sequentially continuous. If there exists 
Pk > rk > such that 

{A2) flfc := sup p{u) ^ and dk ■= sup 'p{u) < co. 
ME Yfc ueYk 
ll"ll = Pfe Iliill^SPfc 

(^3) bk := inf p{u) 00, k ^ co. 
ueZk 
\\u\\=rk 

Then there exists a sequence (M^)n c X such that 

p'iu^) 0, fi^k) ^ Ck := inf sup (^(7(1*)) as n ^ co. 

Proof. Choose k sufficiently large and apply the preceding theorem. □ 

Recall that the functional p satisfies the (PS')c-condition (Palais-Smale condition 
at level c), if every sequence (u„) cz X such that 

p{un) c and p'(un) — > as n co, 

has a convergent subsequence. 

Corollary 13. Under the assumptions of the preceding theorem, if p satisfies in 
addition the {PS)c condition for every c> 0, then p has an unbounded sequence of 
critical values. 

In the sequel | • |p is the usual norm in L'p. 

5. Semilinear Schr5dinger equation 

In this section we apply our abstract theorem to the resolution of the semilinear 
Schrodinger equation 

-Au + V{x)u = f{x,u), 

We define the functional 

:= i r {\\/u\^ + V{x)u^)dx- I F{x,u)dx, ueH^R^). (6) 

It is well known that if p is of class then its critical points are weak solutions 
of dS]). Observe also that, due to the periodicity of / and v, if -u is a solution of 
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([5]), then so is (7 * u for each g e Z^, where {g * u){x) := u{x + g). Two solutions u 
and w of (III) are said to be geometrically distinct if the sets {g * u | g e Z^} and 
{g *v I g e Z^} are disjoint. 
We will prove: 

Theorem 14. Assume (Vq), (/i) — (/s)- T/ien problem ([5]) /las a sequence (ufc) 0/ 
solutions such that tp(uk) — > co, as fc —> co. 

Remark 15. Infinitely many of the solutions obtained in Theorem\l^ above are 
geometrically distinct. In fact, since (f{uk) — >■ 00, as k ^ co, there exists ko > big 
enough such that for every i,j > ko, if i ¥= j then (p{ui) ^ ip{uj). 

Before giving the proof of Theorem 1141 we need some preliminary results. 
Let L be the self-adjoint operator L : H^(R^) H^(R^) defined by 

{Lu,v)i := (Vu ■ \/v + V{x)uv'^dx, 

(where (•)! is the usual inner product in 7J-^(R^)). By assumption (Vq), X := 
H^{M.^) is the sum of two infinite-dimensional L— invariant orthogonal subspaces 
Y and Z on which L is respectively negative definite and positive definite (see [2]). 
We denote P : X ^ Y and Q : X ^ Z the orthogonal projections. We introduce 
a new inner product on X (equivalent to (•)!) by the formula 

(u, w) := (L(Qm — Pu), w) u,v e X 
with the corresponding norm 

M := (u,w)i 

Since the inner products (•) and (•)! are equivalent, Y and Z are also orthogonal 

with respect to (•). 

One can verify easily that © reads 

ip{u) = l-{\\Quf - \\Puf) - \ F{x,u)dx \fu,v e H^{R^). (7) 

We refer the reader to [2] or [25] for the proof of the following lemma. 

Lemma 16. Under assumptions (Vq), (/i) — (fa), ^ is of class and is t— upper 
semicontinuous, and V^p is weakly sequentially continuous. Moreover we have 

l^ip' {u),v) = {Qu,v) — {Pu,v) — vf{x,u)dx. (8) 

We will also need the following lemma due to Brezis and Lieb (see Theorem 2 
in in]). 

Lemma 17 (Brezis-Lieb, 1983). Let J : C ^ C be a continuous function such 
that J(0) = and for every sufficiently small e > there exist two continuous, 
nonnegative functions h^ and g^ satisfying 

\J{a + b)- J{a)\ < ehe{a) + ge{b), for all a,beC. 

Let Un = u + Vn be a sequence of measurable functions from to C such that: 

(i) w„ ^ a.e. 

(ii) J{u)eL\R^). 

(iii) lim sup„ Jjjjjv ht{vn)dx ^ C < co, for some constant C independent of e. 

(iv) Jgjv ge{u)dx < CO. 
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Then 

J\J{u + Vn) — J{vn) — J{u)\dx ^0 as n ^ CO. 

Proof of theorem\T^ Let (ei)i^o be an orthonormal basis of {Z, \\ ■ ||) and let us 
define 

k 00 

Yk:=Y®{@ Me,) and Zk := Me,. 

i— i — k 

k 

Let u = y + z e Yfe, with y eY and z e @ Me^. {fi) implies that for each 5 > 

i=0 

there exists ci = ci{S) such that 

F{x,u) ^ ci\u\^ - 6\u\^, 

and then 

F{x,u)dx ^ <^|u|2 — Ci|m|2^. 



J 



Since the norms || ■ ||i and || • || are equivalent, there exists a constant C2 > such 
that \u\l ^ C2||up = C2(||yp + I^P)- We then deduce that 

^{u)^{6c2-l)\\yr + {l + Sc,)\\zf-c,\u\;. 

Let Ek be the closure of Yfc in L''(M^). We know that the Sobolev space H'^(R^) 
embeds continuously in L''(M^), then there exists a continuous projection of Ek 

k 

on ^ Mei, and since in a finite-dimensional vector space all norms are equivalent, 

i=0 

there is a constant C3 > such that C3j|2;|| ^ Therefore we have 

^(u) < {Sc2 l)\\yr + (i + Sc2)\\zr cic^llzp. 
If we choose S such that 5c2 ^ j then 

(^(m) s; -^ilyf + C4||z||2-C5||z|r, 

for some constants C4 > and C5 > 0. This implies that 

ip{u) —CO as ||u|| — > cx). 

Hence relation {A2) of Theorem [T2] is satisfied for pk sufficiently large. 

Now let u e Zk, then Pu = and Qu = u. Assumptions (/i), (/2) and (/a) 
imply that 

Ve > 0,3q > such that u)| e|u| + c,|w|P"\ (9) 



hence 
and 



F{x,u)^-\u\^ + dM''. 



2' 

Let us define 



u - X u 9 - CJU 



13k ■■= sup |z;|p 
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SO that 



Choosing e = ^ we obtain 



viu)^l{l\\ur-c(3i\\ur). 

Hence we have for ||w|| = := (cp/S^)^^ , 

^(u) ^ i(i-i)(cp/3^)^. 

We know by Lemma 3.8 in '^F that /3fe ^ as fc ^ go, hence relation (A3) of 
Theorem W2\ is satisfied. 

We apply Theorem [T^] with the action of Z2 and wc get the existence of a sequence 
(w^)„3;0 in ^ such that 

vWk) ^ Cfe and v'Wk) ^0 as n ^ cx), for every fc. 

By Lemma 1.5 of ^ the sequence (v'^)n is bounded, and it is evident that for k 
big enough no subsequence of (i'^)„ converges to 0. By Lemma 1.7 of [5], there is 
a sequence (a„) cz and numbers r, 5 > such that 

liminf \vt^dx^ 8^ for k big enough. 

Taking a subsequence if necessary we may suppose that, for k big enough, 

\\vl\\L-iBia^.r))^\. Vn. (10) 

Choose gn e Z^ such that \gn — a„ | = minjlg — a„| : g e Z^}. Thus \gn — o,n\ ^ 
/]V. Define 



ul := g„ * vl. (11) 
In view of pU)) , we have for A; big enough 

ll"fcllL2(S(0,r+iVW)) 2' ^^^^ 

It is not difficult to see that ^'(m^') = (/3(w^) and ||Viy9(u)!)|| = ||V(p(w^')||. Hence we 
have 

(/^(uJJ) Cfc, f'i^k) ^0 as n ^ CO. 

Again by Lemma 1.5 of [2] the sequence (Mfc)n is bounded. Thus we deduce that, 
up to a subsequence, 

Ufe ^ Uk in X, as n ^ co, (13) 

Ufc ^ Uk in Lf„^(R^), as n ^ cx), (14) 

Uk a.e. on R^, as n ^ co. (15) 

By p2p Ufe 7^ for fc big enough, and in view of the weak continuity of V(/3 we get 
that Uk is a critical point of ip, and then a weak solution of ([5]). 
Using and dH) we have, 

^K) = J < > +U O'^^ - f O'^^- (16) 
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By (fT4| we have for < i? < oo 



sup — Mfcp^O, as n ^ cx), 

then by Lemma 1.21 of [35] (see also ) 



< ^ Ufc in LP{R^) as 71 ^ 00. 



Now by dl]) for every e > 0, there is Cg > such that 

\{ul-Uk)f{x,ul-Uk)\dx iie\ul-Uk\l + c^\ul-Uk\l and 



I 



n. 



2 p ^ 

Thus we have 

Irjv (wfc - Uk)f{x, - Uk)dx ^0 as n -> 00 

(17) 

jjgjv -F(a;, — Uk)dx ^0 as n ^ 00. 

One can easily verify that ^ implies that, for almost every x e M^, the functions 
s >— > sf{x,s) and s i-^ F(x,s) satisfy the conditions of Lemma I17[ with u„ = ujj, 
u = Uk and Vn = — Uk- It then follows from Lemma [T71 and (|17p that 

u1f{x, u1)dx Ukfix, Uk)dx as n ^ 00 

(18) 

Jjjjv -^"(2;, u1)dx Jjjjv -f^(a;, Mfc)(ix as oo. 
Taking the limit n co in (|T6)) and using (|T8)) we obtain 

Cfe = f Ukf{x,Uk)dx-{ F{x,Uk)dx. 

Now and dH]) also implies, since ip'{uk) = 0, that 

v(wfc) = ^ ( Ukf{x,Uk)dx- I F{x,Uk)dx = Ck- 
^ Jr" Jr« 

This ends the proof of the theorem, since Cfe ^ 00 as A: ^ 00. □ 

Remark 18. The existence of infinitely many geometrically distinct solutions of 
(O, under (Vb), (/i) — (/s), was first proved by Kryszewski and Szulkin in ^ 
by using the degree we present before and a variant of Benci's pseudoindex [22) . 
However they assumed in addition that there are A > and i? > such that 

\]{x,u + v)- j{x,u)\^\\v\{\ + \uY-^), VxeM^, Vu,weM, with |t;| i?. 

6. NONCOOPERATIVE ELLIPTIC SYSTEM 

In this section we apply our abstract result to the resolution of the following 
potential system 

Au = Hu{x,u,v) in ft, 
-Av = Hylx,u,v) in fl, (19) 
u = V = on dfl, 

where il is an open bounded subset of M^. 

On i?o(r2) we choose the norm ||w|| := |Vw|2, which by the Poincare inequality 
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is equivalent to the usual norm of i?o(fi). On the space X := i?o(r2) x i7g(ri), we 
choose the product norm v)\\ = Vlu]P+|MF ^^'^ define the functional 

$(u,w):= { (hs/vl^ -hvu\^ - H{x,u,v))dx. (20) 

It is well known that if $ is of class C^, its critical points are weak solutions of ([T^ . 
Our main result in this section is stated as follows: 

Theorem 19. Assume that (hi) — (h^) are satisfied. Then (|19p has a sequence of 
solutions (ukjVk) in Hq(J1) x HQ{fl) such that $(ufc,Wfe) — > go as fc —> co. 

The following lemma is well known (see for example [5] or [3]). 

Lemma 20. Under assumptions (hi) and (/12), ^ e C^(X, R) and 

($'(m,u), (fc,/i)) = J {vvVh-VuVk- kHu{x,u,v) -hHy{x,u,v)jdx. (21) 
Define 

Y: = {{u,Q) I ueHlin)}, 
Z: = {{Q,v) I v^Hlin)], 
so that X = Y @Z and 

^{u,v) := ]^\\{Q,v)f - ]^\\{uM? - \^H{^.u,v)dx. (22) 

The proof of the following lemma follows the lines of the proof of Theorem A.2 in 

Lemma 21. Assume that |ri| < 00, 1 ^ p, r < 00 and G e C{Q x R x M) such that 

\G{x,u,v)\^c{l+\u\^ + \v\^). 

Then yu,v e LP{n), G{-,u,v) e L''{fl) and the operator A : LP{n) x LP{n) 
L^{n),{u,v) 1-^ G{x,u,v) is continuous. 

Lemma 22. Under assumption {hi), $ is t— upper semicontinuous and V$ is 
weakly sequentially continuous. 

Proof. (i) Let (u„, w„) e X such that (m„, Vn) {u, v) and c ^ ^{un, Vn). By the 
definition of r we have — > u in 11^(^1) and then (w„) is bounded. Noting 
that c ^ ^{un,Vn) and _ff(x,u„,f„) 5= 0, then (u„) is bounded and u„ ^ u in 
^0(0). Now since the embedding i?o(51) ^ L^(il) is compact, w„ ^ w and 
u„ ^ u in L^{fl). Thus up to a subsequence w„(x) ^ v{x) and u„(x) — > u(a:) 
a.e on fi, and by (hi) H{x, w„(a:), w„(x)) ^ -ff (2:, u{x),v{x)) a.e on $7. It then 
follows from Fatou's Lemma and the weak lower semicontinuity of the norm 
II • II that c ^ $(u,w), and $ is r— upper semicontinuous. 
(ii) Let (m„, Vn) e X such that (u„, t;„) ^ (m, w), then by Rellich theorem u„ ^ u 
and w„ — > w in L^'(ri). By the Holder inequality 



<: 



Jn 

\h\\Hu{x,Un,Vn) - Hu{x,u,v)\dx + \ \k\\Hy{x,Un,Vn) - Hy{x,u,v)\dx ^ 
Jn Jn 

\h\p\Huix,Un,Vn) - Huix, U, v)\ _E- + | fc|p |i?i, (x, W„ , W„ ) - Hy{x,U,v)\_£_. 
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It follows from Lemma [211 that 
[hHu{x,Un,Vn) + kHv{x,Un,Vn) — hHu{x,u,v) — kHv{x,u,v))dx^O asn^co, 

Jo 



Jn 

and then 



(V$(m„, vn), {K k)) -> (V$(w, v), {h, k)) V(ft, k) e X. 
This shows that V$ is weakly sequentially continuous. 



□ 



Lemma 23. Under assumptions (hi) — (/13), every sequence (un,Vn) c X such 
that 

d := sup$(it„,w„) < CO and w„) ^ 

n 

has a convergent subsequence. 

Proof. We know by [23 that (/13) implies: 

3ai,a2>0 such that w, u) 5= ai + - 02. (23) 

For n big enough we have 

d+\\( )\\ ^ $K,v„) - -($'K,v„),(u„,w„)) 

= r \-[unHu{x,Un,Vn + VnH^{x,Un,Vn))dx - \ M„, W„)dx 

Jn ^ Jn 

H{x,Un,Vn)dx 

Jn 

l)[ai(K|^+KiP-C2|f7|]. 



^2 JO 



This implies that 

l"n|^+b«|^«:Ci||K,t;„)||+C2, (24) 
for some positive constants Ci and C2. 
On the other hand, we have for n big enough 



WVnf- 



VnHy{x,Un,V„)dx = ($' (m„ , «„) , (0, -y„) ) ^ \\Vn\\, 

Jn 



and 



UnH^{x,Un,Vn)dx = {- ^'{Un,Vn),{Un,0)) \\Un\\. 

Jn 

We then obtain, by using (/12) 

||u«ir + \\Vnf < llMnll + \\Vn\\ + c(|m„|P + |t;„|P) + C. (25) 

Using (gl) and ^E^, we deduce that 

||(Mn,Wn)P -Dl||(Un,Wn)l| + -D2 , 

for some positive constants Di and I?2- Thus (u„,t;„) is bounded. Up to a sub- 
sequence there exists {u,v) e X such that (u„,w„) ^ (u,v). By Rellich theorem 
(m„,d„) {u,v) in LP(ri) X LP(fl), and by Lemma i/„(x, u„, «„) ^ Hu{x,u,v) 
and Hy{x, u„, t;„) — > Hy{x, u, w) as n — > cx). 
Now one can verify easily that 

||u„-Mp = -($'(«„, Vn)-^'{u, v), {Un-U, 0))- (m„-u)(F„(x, U„, Vn)-Hu{x, U, v)) , 

Jn 
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Jn 

It is clear that ^$'(u„,u„) — $'(u,w),(w„ — u, 0)) ^ as n ^ oo. By the Holder 
inequality and Lemma 



I {Un-u){H^{x,Un,Vn)-H^{x,U,v))\ \Un-u\p\H^{x , Un, Vn)- Hu{x , U, v)\ p ^ 

Jo " 
Thus we have proved that ||w„ — u\\ — > 0. By the same way ||d„ — v\\ — > 0. □ 

Proof of Theorem^^ Let (cj) be an orthonormal basis of i?o(r2) and define 



Yk:=Y® ({0} X Mej) := {O} x Re, 

k 

(i) Let (w, u) e Yfe. By definition of Y^, w e @ Rej, and by 

1 1 f 

^{u,v) = -\\vf - -\uf - \^Jl{x,u,v)dx. 

([23| then implies 



1„ „o 1 



«||^--||7.||^-ai|«|P + a2|r!|. 



Since on the space ©j^qRcj all norms are equivalent, there exists a constant 
c > such that c\vY ^ and hence 

< -i^p + \\vf- a'ill«ir + ail^^l- 

This shows that ^ — cx) as oo, so condition (^2) of Theorem 

[T^is satisfied for p^. large enough, 
(ii) Let (0, w) e Zfc, then by ^ 

i.(0,w) = - r 0, 

2 Jo 

We deduce from (/12) the existence of c > such that 
\H(x,u,v)\ c(l + + 

which implies that 

'J>(0,«)> ^lkll'-c|?;|^-c|17|. 

Define 

/3fc := sup 

||u|| = l 

Then we have for 

||w|| = := {cpf3l)~, 
2 p 
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We know by Lemma 3.8 in [25] that /3/c ^ as fc ^ go, so $(0, u) go 
as fc ^ GO and condition (A3) of Theorem [T2] is satisfied. By Lemma [23l $ 
satisfies the Palais-Smale condition and by (h^) $ is even. 

We then conclude by applying Corollary [T3] with the action of Z2 . □ 

Conclusion 

In this paper, we presented a generalization of the Fountain Theorem to strongly 
indefinite functionals. The use of the r— topology introduced by Kryszewski and 
Szulkin permitted an extension of the Borsuk-Ulam Theorem to cr— admissible func- 
tions making the above-mentioned generalization quite natural. We believe that the 
ideas presented in this paper could be used to similarly generalize a result like the 
dual version of the Fountain Theorem (see [IS], Theorem 3.18 for instance). An 
adaptation of these ideas to separable reflexive Banach spaces will be also the sub- 
ject of future research. 
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